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Abstract of JP4024885 

PURPOSE:To improve reading environment 
by extracting a color character picture 
corresponding to a color characteristic as the 
object of reading from a medium on which a 
color character is recorded, and outputting it to 
a character recognizing part. 
CONSTITUTION:ln the case of the medium 
designated for the reading, a picture input part 
1 outputs its picture signal to a color 
characteristic storage part 3, and the color 
characteristic storage part measures and 
stores the color characteristic, and in the case 
of the document of the object of the reading, 
the picture input part 1 outputs its picture 
signal to a picture extracting part 4, and the 
picture extracting part 4 extracts the character 
picture corresponding to the color 
characteristic or the character picture in a color 
mark area as the object of the reading on the 
basis of the color characteristic stored in the 
color characteristic storage part 3, and outputs 
it to the character recognizing part 5. Then, the 
character recognizing part 5 executes the 
inclination correction, etc., of the extracted 
document picture, and segments the charac 
ter picture by every one character, and 
recognizes and converts it into a character 
code, and a voice synthesizing part 6 converts 
this character code into voice waveform, and a 
voice is outputted from a voice output part 7. 
Thus, the reading environment is improved. 




Data supplied from the esp@cenet database - Worldwide 



G OB K 9/20 
Q 06 F 3/16 



© B * m 4# flp ff (J P) ©^F^ftH^M 

>3fcBI4#f*&* (a) ¥4-24885 

*f JfrtSBB*^- ®£M ¥fi£4«1992) 1A28B 

C 9073-5L 
X 8323-5B 



©& m ¥2-130874 

@Bi m ¥2(1990) 5J321B 

®m m m % » « a 3nR»«Kifcyn its 7 #12^ Nsaii^ttst&ttrt 

Sfcb 61 A ftWfMLmW^&tt. Sm«5^E.^^P^lTB7#12^ 

«fts*65*© zmzmmi * 5 groin 5 Bo-g&Mt^sttfc -r s 



« ffl * 

1 . ^BJ3««» 

2 . tf If IS^COlSffl 

(1) «{*±w5c^4iSitt s^c^iS^SUi > s 
£ * IS 18 sis -e IS IS <* fc is at W * *c £ ^ ^ -c f ?s 

s«i*»3ein*±w64#ft tans uTgeati-afe 

(2) mffittf*tt * 7 - -v- 0 ^iiSaXUEDJBU^ 



a. 

(3) lffl£»*Hi£tt#»*R*#*ttjllt*-t-jA 

*«(i>xt±(2)ia«oSE»7a,as®. 

3 . S«oS¥ffi&Siq3 
cot Jfe 5 . 

a«^^ft*W^«« f?8*Vol.8 7 

No. 334 1 988*plJf22B£:fT P7 
9-8 6KB9*3Mfct«)4<fc-,t, »2B(il 

ttv B«A7)gE 2 1, B«MSgK 2 2, X^igH 
SB 2 3 v t^-g-figgl? 2 4 S.r>'^^ffi*S15 2 5 



ADi. zomftizii t-c, a^aasB 2 2 -c^ 

g^IE^roBjfc&gSrfi'ftv^ x^isiaBis 2 3 -e 
it. 

b*>bft#^±SS*«<o&*<7)Sc*&5It£gT 
£ ,Tfiv>SS8St»ii t± A. ft . 

<2) mm^mts 

(3) % , g3 # <?) |g € % St tr 

(4) #=%:£l««:8l!tr 

(5) _b3afc*D-»fc.fc-P£:3:*:St»a»ai*t£V 4 *» 



»BB¥ 4-24885(2) 

SB ( ± _h is o) .6 k m * x ft n fc * -c ± se 

JbBHt IB afc*>*S6W 
t > 

& * a as * ± & # tt * «j s l t ib m -t & & 

«r «f®: tti. 

* *: , n * 5 - ^ - ^ *< ji ie x t± bj bo * n 



(±B«A^88*±*wa«!ffi-^*B«J*aJ8l!tcffiS 



& U-cBE*±lf Scot, 5f B Sfftfcfrft -> 

•3 *S -C g & . 

coScSS^<7>isj_hi; t.as-5. 

t5. 

fltSEi^i-yDv^EatabS. SI + S J: -5 i~ , 
(ft SB 2 , fe^ttlSffigBS, B« » m SB 4 , 

mass, %7B&m.%?, e ao-^Fffi^gK 7 * Affi-r 

B«A^Jgfili±, i40,»5Hlc*tJ;?S: 



^isi(YY)iLTiiu fflte±t:ie«^ n-c 

w^^efXI±R(#), G(8), B(S)0 
5 . 

Stlfe*- KSJ&gli 2 l±, EItS L ftv>x 4 f- 

#£fi&tt3Sff^3XWi@«»a334^£t0£l3_ 
Wat*- K«J*«2 tt, a<0i:*tJ;7ft 
KcoSJ-g-lctiBSfcAagf! 1 frt»)lff 
W £, W ItHS SB 3 ^-iJj^J L > »5B1(;S+J:7 

5 . 

■fe » ft Sa « SB 3 t± , » 4 Bit: ^ -t J: 3 ft Sc 3 

s«+a. 

LtUSftlSWtSLt^Tij^T, RGB 

*«ig«f§^ £ jegfSe^ A(D * fflv "C X Y Z 3£ 

KM t . 

X = 2. 7689 R + 1. 7517 G + 1. 1302 B 
Y = R + 4. S907 G + 0. 0601 B 

Z- 0.0S65G + 5.5943 B (1) 

^fttftt^ X, Y, ZO> t\Z^(Z)iiM^X 

fejSffi^x , y *ft«U 
s=X/(X+Y+Z) 

y-Y/(X+Y+Z) (2) 

± i£ co R G B»i>«Y Z * ~ (7> ^ & C * ( 1 ) 

9 C *(2)£ fflV> 3 )tt«iaR , G , B * A 
JL V X, Y, ZiKJtJROMifflV'T, & 
O'X.Y, Z i A J t , x , y*S»»*-Cili3J 

tJROMiffli'Tistsiita^x^ its 



J?B8¥ 4-24885 (3) 
U BiU sc* = - k •=«*■*•*. 

£^I2sS£gfS 5 it, K«r*J»«»fc 

»3BI±S4« - KRtfSE******-*'-?* 

zRi-feSek RISK b ) li-7-^0«SffiHc7)|5l 
sfl E9 -c *> S . 
« 3 B C a ) fcw + JKSfcffiir' B«A 

a as i k a. Miif rg b #fi u 
* * a a -c s s*7-^t^ti'iistti. 

» 3 SIC b)(c^ + JRg^fflV'S«-^, B»A 
5 . 

ftv^aifw^juTabo-c, ffloB^ — £ <?> # S 
SY*l!l«(:Ilti:4JiV'. 

TttI(iW«fI&ft05fcJ0KaS 3 H C a ) fc^-t&JS 

s«^«ftx^?j, M2iin*±if 
ft £ u ss^ffifts* 

3fJ , T 1 , T2liin-E'ttt?aMl , M 2 izn 
JS Lfcjfi*?!. onliS*?IMl , M2K»(£L 
t, 3t* . #JScoS!*±lf *t * « Sfc it ffi 4 ft 



Si** - KttfS 4 B!fc* + J: ? tc#*fiEi* nx ^ 
{f^MxS> 0 Se«ffl** s ff Steffi- S^H 

*im-ct> a. 

««i L , *« *W(± r H#j j . r SSSift* 

S; €,#141211 SB 3 It R G B 3&<7>H«<5^^ <bf# 
fcnafijgj£4«x , y«ll[(k, WKM 1 0 oe 
U-Ctt«tft L fc x „ , y „* T K u 7. t -f S 2 
>ti|(*7-Tr^)tS*,, SB 4 12 K + J: 

fflV^Tl!JBJ?i- J, . & 6 BItC *iV>T, H*f YY 1 

IZ Y Y 3 ff-Ctt file-?- ? Bil&KiiSS L , JS-Ogi 
**,7iH«CXX3 1 w ~ X X 3 2 b + 

-c®«ttagii 4 * tx^SBiaa! s twjt a. ffi 
jt»f k-c - 9 b* (c m * nfcg« 4 r*» * 

C0B«i LtltjLt^Jii, Y Y nfrK. 

tt&ft«)StIitfiBasS 6 0 - 5 5 8 6 8 

l X *> S 1 b iC , TS;(3)«rffilr'Tfift 

7 . 

XX(i-l)kbSXXikw 
XX(i-l)kw£XXikb (3) 
lit, XX(i-l)kt,XX(i-l)k» 



Jfffl¥ 4-24885 (4) 

7 — -7 y t rfeXSclZ 7?7{: r 0 j £ £0 
#Hti~ a. i6E^-c*3£7iS0fSwfi« C ms 

fc x* . y s l: £81 ts - <?) x * . r«S:7F^i 

fjA7-7Wt r i j*s?iiti. a *s „ 3f 

r , G , B4t#-|v ^ Ji-Jit T W S , £3tSc 
£ JfH-tf&BJI- 4. 

* r , - si su*as n &<z> x. b iz t x *t a 

5. i«AJ3 1 *S 5 HCSt J: ? ftfflttCM 
L-C£jg3E**¥^(Sl C X X 5 . 19*^4: SIC* 
ft < Y Y ) t LtilSttlfiJJtliRGBW* 
tt KJUfS-^ *• iW$0>3S;(l> . (2)£ffl^Tfe&j£ 
S x , yKgEi&L, , yfcgBMfctfcx,, 

m t, ss * 7 - -7 r i j co^-g-, 

l«**ffiYY ifi-^iiTtSffYY i - 1 <7>fe 

gg * S5 1" , XXi kb , XXi k w t± # * pife3£ ft 
Y i«)6SS r 0 jA»fc>fjlefe#f4t(B)-^fe# 

tS r j j ~^£4t.3&VfjKfif?tt r j j*><bfe 
U fe#f±IfiHgl! 3 K^S&Sj? 7 ytf-k -y hi? 

X Bifetttti gfi 4 ib tuji-t a . 
a*s, SE**f*«oS:« . 

(±, B««3ffia5 4 t 16 SrISttX 

S3 8. X¥E8^§1!2 3i>bajMSMU« 
ttti< iifcifl, -v-?BS!f: 

.t a^«&sft* + a ^ i 7i<^i«T3b a. 

WT R . G , B«ISf*!4-CK-t:Sv>Kjut:fe 

a n 1 j: t a . 



S. ft*)'. 2 <1 -ft <7> Wffitt&fcJ <» SB Gift S 

SE»*t*fc» s lat^-r <t -5 n r i§» j iii 

L v IB 6 EMCw-fXS* A23 L ^-?ro 

£ « * ra s * as * s ft at *> n a . 

«rti«ttffi«l«#7Si4'), 19 S £ *x S! i6 
t, I*±lf SWT, ««**«H#Wt:fTft->T 

« aSESMSSg=tei«-r s a i v> $*nfc»* 
##<bna. 
4 . Hffi<o«**»i^ 
s?iEifi*^Hj3ro*jfiwi<75S?s«iasa(7)«i«; 

(?) is a§ rase a 3(±^-^we,jEffiaoosea 

ia, »4i8liRI*- KtfJflltwtH, ISSBtt 

is m m -c * a . 

12 4», 1 ®<&A;t!gB, 2 ScJft^-Kffl 

»B5, 3 • • • ••fe^ttisfssB, 4 ■•••a*#imas. 



4-24885(6) 

a . 
a . 

(1) Set*- ^^^^XilliJtKlt 

ne. 

(2) Sc#*- KcoBfScofe®(i*ii3iJ-7- 7 £tt 
Aa+ai*(:«SUv-^c7)***^ffli-s«tg 0 

(3) gt#*-h-(7>W^«feg:t:ti0iJ*^4:» 
it, *0>®»?4;s£$ffii-atKJi. 

(4) 3cS*- KSTJBcoA;fi«Br£I8!» ( B«A 

tfeffi-f a««s. 

[ »W<*>3»* } 

JK±»i(fflteg(iBfl Ufc J: ■? fc*S5Wte J:tif±', « 
#***X*#S^}&^SE*4:ff ft => fi-cSSS 

Sfasfifi-fcs^stc&bi+fcfeiSStc^jE-ta* 
5----a*b»o. 6 ••••*^#«aj. 

^ * 23 SB . 



If BB¥ 4-24885 C6) 




Whole Englsih translation of JPA4-24885 



(11) Japanese Patent Laid-Open No. 4-24885 

(43) Laid-Open Date: January 28, 1992 

(21) Application No. 2-130874 

(22) Application Date: May 21, 1990 

(71) Applicant: OKI ELECTRIC IND CO LTD 

(72) Inventor: Masahisa Yano 

Yoshiyuki Yamashita 

Specification 
1. Title of the Document 

READING PROCESSING DEVICE 

2 . Claims for the Patent 

(1) A reading processing device provided with a 
character recognition unit which recognizes characters 
on a medium and a speech synthesis unit which 
synthesizes speech based on the result recognized at 
the character recognition unit and outputs a speech 
sound as a result of recognition, the reading 
processing device characterized by comprising: 

an image input unit which scans the medium and 
outputs an image signal; 

a color characteristic storing unit which measures 
the color characteristic of a medium designated as an 
object to be read and stores the color characteristic; 
and 
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an image sampling unit which samples a color 
character image corresponding to the color 
characteristic as an object to be read from the medium 
on which a color character is written and outputs the 
color character image to the character recognition unit. 

(2) The reading processing device according to claim 1, 
wherein 

the medium is such one that a color mark is added 
thereto or printed thereon, and the image sampling unit 
detects the color mark based on the color 
characteristic and samples the character image in the 
area of the color mark as an object to be read. 

(3) The reading processing device according to claims 
1 or 2 , wherein 

the medium designated as an object to be read is a 
card on which Braille representing classification of an 
object to be read is written. 

3. Detailed Description of the Invention 
[Industrial Application Field] 

The present invention relates to a reading 
processing device for outputting reading voice 
according to a result of recognition of characters on a 
document and book. 
[Conventional Art] 

A reading processing device of this type was 
disclosed in "Technical Report of the Institute of 

- 2 - 



Whole Englsih translation of JPA4-24885 



Electronics, Information and Communication Engineers 
(IEICE) , Vol. 87, No. 334, pp. 79 to 86, January 22, 
1988. Figure 2 is a block diagram illustrating the 
composition of the reading processing device of this 
type stated above. As illustrated in the figure, the 
reading processing device includes an image input unit 
21, image processing unit 22, character recognition 
unit 23, speech synthesis unit 24 and speech output 
unit 25. 

The operation of the reading processing device is 
such that a document or book is input into the image 
input unit 21 on a page basis, an image thereof is 
subjected to image processing such as inclination 
correction by the image processing unit 22, the output 
image characters on the document are segmented and 
recognized by the character recognition unit 23 and a 
speech sound is output as a final output. 
[Problems to be Solved by the Invention] 

However, a conventional reading processing device 
with the above composition does not enable to select 
from among such various readings stated in the 
following that the robust is ordinarily performing when 
reading a document and book. The device has not 
provided the blind or physically handicapped person 
with a favorable reading environment. 

For example, if a document or book to be read is a 
paper, 

- 3 - 
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1) reading bibliographic items such as a title, 
author and others, 

2) reading an abstract, 

3) reading the title of a chapter and paragraph, 

4) reading references, and 

5) determining whether all texts should be read 
based on the above information. 

The present invention has been made in view of the 
above problems. It is an object of the present 
invention is to provide a reading processing device to 
solve the above problems, which is capable of freely 
selectively reading the portion of sentences marked 
with color on a document and book, skimming the 
document and book in substantially the same manner as a 
sighted person ordinarily does and being helpful to 
improve a reading environment for a handicapped person. 
[Means for Solving the Problems] 

To solve the above problems, the reading 
processing device according to the present invention is 
characterized by including: 

an image input unit which scans the medium and 
outputs an image signal; 

a color characteristic storing unit which measures 
the color characteristic of a medium designated as an 
object to be read and stores the color characteristic; 
and 

- 4 - 
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an image sampling unit which samples a color 
character image corresponding to the color 
characteristic as an object to be read from the medium 
on which a color character is written and outputs the 
color character image to the character recognition unit. 

In the reading processing device according to the 
present invention, the medium is such one that a color 
mark is added thereto or printed thereon, and the image 
sampling unit detects the color mark based on the color 
characteristic and samples the character image in the 
area of the color mark as an object to be read. 

In the reading processing device according to the 
present invention, the medium designated as an object 
to be read is a card on which Braille representing 
classification of an object to be read is written. 
[Operation] 

The reading processing device of the present 
invention is composed as described above. For the 
medium designated as an object to be read, the image 
input unit outputs an image signal to the color 
characteristic storing unit, and the color 
characteristic storing unit measures and stores the 
color characteristic. For a document as an object to 
be read, the image input unit outputs the image signal 
to the image sampling unit and the image sampling unit 
samples a color character image corresponding to the 
color characteristic or character image in the area of 
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a color mark as an object to be read based on the color 
characteristic stored in the color characteristic 
storing unit and outputs the image to the character 
recognition unit. The character recognition unit 
subjects the sampled document image to a process such 
as inclination correction, segments the character image 
on a character-by- character basis, recognizes the 
segmented character image and converted it into 
character codes. The speech synthesis unit converts 
the character codes into speech waveforms. The speech 
output unit outputs a speech sound. 

That is to say, the operation of the reading 
processing device is such that color marks according to 
importance are added to or printed on a desired portion 
of the document or book in a procedure in which the 
robust skims a document or book and the reading 
processing device freely selectively read the sentences 
marked with color, thereby the reading processing 
device can read them in substantially the same manner 
as a sighted person ordinarily skims document or book. 

Using a card written in Braille expressing the 
classification of an object to be read as a medium 
designated as an object to be read is helpful to 
improve a reading environment for a handicapped person 
such as the blind. 
[Embodiments] 

- 6 - 
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One embodiment of the present invention is 
described below with reference to the drawings . 

Figure 1 is a block diagram illustrating the 
composition of the reading processing device according 
to the embodiment of the present invention. As 
illustrated in the figure, the reading processing 
device is provides with an image input unit 1, reading 
mode switching unit 2, color characteristic storing 
unit 3, image sampling unit 4, character recognition 
unit 5, speech synthesis unit 6 and speech output unit 
7. 

The image input unit 1 scans a form illustrated in 
Figures 4 and 5 in the horizontal direction (XX) as 
main scanning and in the vertical direction ( YY) as 
sub- scanning and outputs an image signal corresponding 
to a mark written in the form and/or one or both of 
gradation and color of a document and drawing, for 
example, a density multi-level signal or red (R) , green 
(G) and blue (B) multi-level signals to the reading 
mode switching unit 2 . 

The reading mode switching unit 2 switches the 
image signal from the image input unit 1 to the color 
characteristic storing unit 3 or the image sampling 
unit 4. For the reading card illustrated in Figure 4, 
the reading mode switching unit 2 outputs the image 
signal from the image input unit 1 to the color 
characteristic storing unit 3. For a document as an 

- 7 - 
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object to be read illustrated in Figure 5, the reading 
mode switching unit 2 outputs the image signal from the 
image input unit 1 to the image sampling unit 4 . 

The color characteristic storing unit 3 measures 
the color characteristic of a predetermined area (ms) 
of the reading card illustrated in Figure 4 and stores 
it therein. 

The image sampling unit 4 samples the image in the 
color mark area written in the document as an object to 
be read and book illustrated in Figure 5 based on the 
color characteristic. 

The character recognition unit 5 subjects the 
sampled document image to inclination correction, 
segments the character images on a character-by- 
character basis, recognizes and converts them into 
character codes . 

The character recognition unit 5 converts the 
character codes into speech waveforms and outputs them 
to the speech output unit 7 . The speech output unit 7 
outputs speech sound. 

Figure 3 is charts for the color characteristic 
describing a principle for classifying marks for the 
reading card and document as an object to be read on a 
color basis. Figure 3(a) is a chromaticity diagram 
representing the range of chromaticity coordinate of 
the mark. Figure 3(b) illustrates the range of density 
of the mark. 

- 8 - 
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When the principle in Figure 3(a) is used, the 
image input unit 1 needs a color scanner capable of 
outputting, for example, a density multi-level signal 
of the RGB system. 

When the principle in Figure 3 (b) is used, the 
image input unit 1 needs a monochrome scanner capable 
of outputting a density multi -level signal or the above 
color scanner. 

Figure 3 (a) is a schematic chromaticity diagram 
formed by a known method. The RGB density signals are 
converted into the XYZ system using a coordinate 
transformation equation (1) : 

X = 2.7689R + 1.7517G + 1.1302B 

Y = R + 4.5907G + 0.0601B 

Z = 0.0565G + 5.5943B (1) . 

The chromaticity coordinates x and y are 
calculated using an equation (2) based on the obtained 
X, Y and Z, 

x = X/ (X + Y + Z) 

y = Y/ (X + Y + Z) (2) . 

The chromaticity diagram uses rectangular 
coordinates based on the chromaticity coordinates x and 
y. The chromaticity coordinates x and y represent hue 
and saturation respectively and Y denotes lightness. 

The above RGB system is converted into the XYZ 
system (using the equation (1)) by use of a ROM which 
receives R, G and B and outputs X, Y and Z and the 

- 9 - 
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chromaticity coordinates x and y representing hue and 
saturation respectively are obtained (using the 
equation (2)) by use of a ROM which receives X, Y and Z 
and which outputs x and y in an integer form, which 
eliminate the need for a calculating time to speed up 
the process. 

For Figure 3 (b) , a document or drawing whose area 
is sampled is represented in black and white, density 
level of a mark on a manuscript is not the same as the 
density of the black and white and color having a 
density level at which the color of the mark does not 
overlap each other on a color basis is selected to 
enable color to be classified. The lightness Y may be 
similarly represented. 

The color characteristic stored in the color 
characteristic storing unit 3 in Figure 1 is not 
limited to the abovementioned principle, but it may be 
converted into another known color characteristic and 
used. In the present invention, however, the color 
characteristic is stored using the chromaticity diagram 
illustrated in Figure 3(a) to simplify description. 

Figure 4 is one example of a reading card. 
Reference character Ml denotes a visible character 
string expressing the classification of a book; M2 , 
visible character string showing name provided at an 
area to be read; Tl and T2 , Braille strings 
corresponding to the character strings Ml and M2 
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respectively; and ms, color mark corresponding to the 
character strings Ml and M2 and having the same color 
characteristic as the color mark added to or printed on 
the area to be read on the document or book. 

The reading card is formed, as illustrated in 
Figure 4, so that both the robust and blind people can 
simply operate the card. A user of the device may form 
it at the discretion. 

In addition, it is enabled to extend an object to 
be read in such a manner that a reading card is 
prepared in which the classification of a book is set 
to, for example, patent, paperback book, magazine, in- 
house document, newspaper or the like as well as the 
paper and in which an appropriated name is given to the 
area to be read for each classification of a book. 

Hereinafter, the reading card is targeted at a 
paper, area names are "abstract," "bibliographic item," 
"title of chapter and paragraph" and "references." The 
respective colors are green, red, blue and yellow. 

The operation of the color characteristic storing 
unit 3 is described below. The color characteristic 
storing unit 3 has a two-dimensional memory (color map) 
with the chromaticity coordinates x and y, as an 
address, obtained from the RGB image signal which are 
made integral, for instance, x% and y% in which the 
chromaticity coordinates x and y are multiplied by 100 
and made integral. When reading the card designated as 
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an object to be read illustrated in Figure 4 is started, 
the color map and an all-sentences reading flag are 
initialized to "0." Subsequently, scanning reaches a 
predetermined area (ms) , the RGB image signals to be 
input are converted into the integers x% and y%, and 
written in the color map "1" with the x% and y% as 
address. Incidentally, if the predetermined area (ms) 
is black, in other words, if all the RGB image signals 
do not exceed a constant level, the all-sentences 
reading flag is set. 

The mark discrimination process and image sampling 
process in a mark area in the image sampling unit 4 are 
described below with reference to Figures 5 to 6 . 

The mark discrimination process is performed as 
follows. The image input unit 1 scans a form 
illustrated in Figure 5 in the horizontal direction 
(XX) as main scanning and the vertical direction (YY) 
as sub-scanning. The output RGB multi-level signals 
are converted into the chromaticity coordinates x and y 
using the equations (1) and (2) . The color map in the 
color characteristic storing unit 3 is referred using 
the x% and y% in which the chromaticity coordinates x 
and y are made integral to discriminate that a scanning 
point lies on the mark if the color map is "1." 

The image sampling process in a mark area is 
described with reference to Figure 6. In Figure 6, a 
mark image is not detected in the sub-scanning line YY1 . 
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However, the mark image of a color characteristic "j" 
stored in the color map is discriminated in the line 
YY2 by the mark discrimination process. In the line 
YY3, images (XX31w to XX32b) connected to the mark 
image and interposed therebetween exist, so that the 
interposed images are output as images to be read from 
the image sampling unit 4 to the character recognition 
unit 5. The images interposed between the mark images 
are output as images to be read through the above 
procedure, however, when scanning reaches the sub- 
scanning line YYn where mark images to be connected do 
not exist, sampling images to be read is finished. 

A determination is made using the following 
equation (3) as to whether a mark image is connected, 
as described in detail in a known art, for example, in 
Japanese Patent Publication No. 60-55868: 

XX (i - 1) kb < XXikw 

XX (i - 1) kw < XXikb (3) , 

where, XX (i - 1) kb and XX (i - 1) kw represent the 
coordinate X of a pair of turning points from a color 
characteristic "0" in the scanning line YYi-1 preceding 
the scanning line YYi to the color characteristic "j" 
and from the color characteristic "j" to the color 
characteristic "0" respectively and XXikb and XXikw 
represent the coordinate X of a pair of turning points 
from a color characteristic "0" in the scanning line Yi 
to the color characteristic "j" which is the same as 
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the aboveraentioned color characteristic and from the 
color characteristic "j" to the color characteristic 
"0" respectively. However, if the all-sentences 
reading flag is set to the color characteristic storing 
unit 3, the above process is not performed and all the 
images output from the image input unit 1 are output 
from the image sampling unit 4 as an image to be read. 

If a document or book to be read is an achromatic 
color, an achromatic image sampling means is provided 
on the image sampling unit 4 so that the images output 
from the character recognition unit 23 are limited to 
an achromatic image, thereby enabling eliminating the 
influence of the mark image. 

The achromatic image sampling means can be 
realized by a known art, for example, all the R, G and 
B signals being almost in the same level. 

A binary means is connected to the achromatic 
image sampling means to take the binarized image to be 
an image to be read. The threshold for binarization 
may be determined by any known method. 

If "abstract" is designated as an object to be 
read as illustrated in Figure 5 and the document in 
Figure 6 is input, the image surrounded by the mark m2 
is output as an image to be read. The characters in 
the image are segmented, recognized and speech- 
synthesized, output as reading voice. Similarly, if 
"bibliographic items" or "titles of chapters and 
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paragraphs" are designated as an object to be read, the 
same process is performed. 

A position where a mark is added to the reading 
card, document and book, size, number and shape of the 
mark are not limited to the above. 

In the above description, although a color mark 
portion on a book is selected, a book of which 
characters are printed in different color instead of 
the color mark is prepared and the color of the 
characters may be selected. If characters different in 
color are printed for each reading area, the image 
sampling unit 4 does not need performing the mark 
discrimination process and image sampling process in 
the mark area and directly samples images of set 
reading color-characteristic as images to be read. 

Adding the following functions to the reading mode 
switching unit 2 allows automating a switching 
operation: 

(1) Function in which the size of the reading card 
is reduced as compared with a document and book to 
compare the size of a form; 

(2) Function in which a discriminating mark is 
added to a predetermined position of the reading card 
to detect whether the discrimination mark exists; 

(3) Function in which a notch is provided in a 
predetermined position of the reading card to detect 
the notch. 
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(4) Function in which a place where only the 
reading card is input is provided (a position where an 
image is input is the same) to detect whether the card 
passes the place. 
[Advantages of the Invention] 

As described above, according to the present 
invention, the operation of the reading processing 
device is such that a color image corresponding to the 
color characteristic of a document and book or a color 
mark corresponding to the color characteristic 
according to importance are added to or printed on a 
desired portion of the document or book in a procedure 
in which the robust skims a document or book and the 
reading processing device freely selectively samples 
the document marked with color in a document or book, 
thereby the reading processing device can read them in 
substantially the same manner as a sighted person 
ordinarily skims document or book. The reading 
processing device provides such an excellent advantage 
that it is helpful to improve reading environment for a 
handicapped person such as the blind or physically 
handicapped person and to provide also the robust with 
the same reading environment as the visual reading 
environment . 

4. Brief Description of the Drawings 
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Figure 1 is a block diagram illustrating the 
composition of a reading processing device according to 
the embodiment of the present invention. 

Figure 2 is a block diagram illustrating the 
composition of the reading processing device of a 
conventional embodiment. 

Figure 3 is charts describing the color 
characteristic: Figure 3(a) is a chromaticity diagram 
expressing the range of chromaticity coordinate of a 
mark; and Figure 3 (b) illustrates the range of density 
of the mark. 

Figure 4 illustrates an example of a reading card. 
Figure 5 illustrates an example of a document to 
be read. 

Figure 6 illustrates image sampling. 

In the figures, reference numeral 1 denotes an 
image input unit; 2, reading mode switching unit; 3, 
color characteristic storing unit; 4, image sampling 
unit; 5, character recognition unit; 6, speech 
synthesis unit; and 7, speech output unit. 
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Figure 1 

#1 BLOCK DIAGRAM ILLUSTRATING COMPOSITION OF READING 
PROCESSING DEVICE ACCORDING TO EMBODIMENT OF PRESENT 
INVENTION 

1 IMAGE INPUT UNIT 

2 READING MODE SWITCHING UNIT 

3 COLOR CHARACTERISTIC STORING UNIT 

4 IMAGE SAMPLING UNIT 

5 CHARACTER RECOGNITION UNIT 

6 SPEECH SYNTHESIS UNIT 

7 SPEECH OUTPUT UNIT 

Figure 2 

#1 BLOCK DIAGRAM ILLUSTRATING COMPOSITION OF READING 
PROCESSING DEVICE OF CONVENTIONAL EMBODIMENT 

21 IMAGE INPUT UNIT 

22 IMAGE PROCESSING UNIT 

23 CHARACTER RECOGNITION UNIT 

24 SPEECH SYNTHESIS UNIT 

25 SPEECH OUTPUT UNIT 

Figure 3 (a) 
#1 GREEN 
#2 BLUE 
#3 YELLOW 
#4 RED 
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#5 CHROMAT I C I T Y DIAGRAM EXPRESSING RANGE OF 
CHROMAT I C I T Y COORDINATE OF MARK 

Figure 3 (b) 

#1 DENSITY 

#2 COLOR 

#3 DENSITY RANGE OF BACKGROUND 

#4 DENSITY RANGE OF MARK PORTION 

#5 DENSITY RANGE OF CHARACTER AND FIGURE 

#6 BACKGROUND (WHITE) 

#7 MARK 

#8 CHARACTER AND FIGURE (BLACK) 

#9 RANGE OF DENSITY OF MARK 

#10 COLOR CHARACTERISTIC 

Figure 4 

#1 EXAMPLE OF READING CARD 
Ml CLASSIFICATION OF BOOK 
M2 PAPER 
M3 ABSTRACT 

Figure 5 

#1 READING DEVICE FOR BLIND 
TAROU X 

ELECTRIC INDUSTRIES CO., LTD. 
#2 SUMMARY 

KANJI-KANA SENTENCE 
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DIRECTLY OUTPUTTING SPEECH 
#3 PREFACE 
#4 COMPOSITION 
#5 DOCUMENT 
#6 FIGURE 1 

#7 EXAMPLE OF DOCUMENT TO BE READ. 
Figure 6 

#1 SAMPLING IMAGE 

#2 IMAGE OF SET COLOR j 

#3 IMAGE OF BACKGROUND 

#4 MANUSCRIPT 

#5 IMAGE SAMPLING 
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